Hewlett Packard Enterprise Frontier, or OLCF-5, is the world's first

exascale Exascale computing refers to computing systems capable of calculating at least "1018 IEEE 754 Double Precision (64-bit) operations (multiplications and/or additions) per second ( exaFLOPS)"; it is a measure of supercomputer performance. Exascale ...

supercomputer A supercomputer is a computer with a high level of performance as compared to a general-purpose computer. The performance of a supercomputer is commonly measured in floating-point operations per second ( FLOPS) instead of million instructio ...

, hosted at the

Oak Ridge Leadership Computing Facility The Oak Ridge Leadership Computing Facility (OLCF), formerly the National Leadership Computing Facility, is a designated user facility operated by Oak Ridge National Laboratory and the Department of Energy. It contains several supercomputers, t ...

(OLCF) in

Tennessee Tennessee ( , ), officially the State of Tennessee, is a landlocked U.S. state, state in the Southeastern United States, Southeastern region of the United States. Tennessee is the List of U.S. states and territories by area, 36th-largest by ...

, United States and first operational in 2022. It is based on the Cray EX and is the successor to Summit (OLCF-4). , Frontier was the world's fastest supercomputer using AMD

CPU A central processing unit (CPU), also called a central processor, main processor or just processor, is the electronic circuitry that executes instructions comprising a computer program. The CPU performs basic arithmetic, logic, controlling, a ...

s and GPUs. Frontier achieved an Rmax of 1.102 exaFLOPS, which is 1.102 quintillion operations per second. Measured at 62.68 gigaflops/watt, Frontier topped the Green500 list for most efficient supercomputer, until it was dethroned by

Flatiron Institute The Flatiron Institute is an internal research division of the Simons Foundation, launched in 2016. It comprises five centers for computational science: the Center for Computational Astrophysics (CCA); the Center for Computational Biology (CCB); ...

's Henri supercomputer in November 2022.

Design

Frontier uses 9,472

AMD Epyc Epyc is a brand of multi-core x86-64 microprocessors designed and sold by AMD, based on the company's Zen microarchitecture. Introduced in June 2017, they are specifically targeted for the server and embedded system markets. Epyc processors shar ...

7A53s "Trento" 64 core 2 GHz CPUs (606,208 cores) and 37,888

Radeon Instinct AMD Instinct is AMD's brand of professional GPUs. It replaced AMD's FirePro S brand in 2016. Compared to the Radeon brand of mainstream consumer/gamer products, the Instinct product line is intended to accelerate deep learning, artificial neu ...

MI250X GPUs (8,335,360 cores). They can perform double precision operations at the same speed as single precision. "Trento" is an optimized 3rd Gen EPYC CPU ("Milan"), which itself is based on Zen 3. It occupies 74 rack cabinets. Each cabinet hosts 64 blades, each consisting of 2 nodes. Blades are interconnected by HPE Slingshot 64-port switch that provides 12.8 terabits/second of bandwidth. Groups of blades are linked in a dragonfly topology with at most three hops between any two nodes. Cabling is either optical or copper, customized to minimize cable length. Total cabling runs . Frontier is liquid-cooled, allowing 5x the density of air-cooled architectures. Each node consists of one CPU, 4 GPUs and 5 terabytes of flash memory. Each GPU has 128 GB of RAM soldered onto it. Frontier has coherent interconnects between CPUs and GPUs, allowing GPU memory to be accessed coherently by code running on the Epyc CPUs. Frontier uses an internal 75 TB/s read / 35 TB/s write / 15 billion IOPS flash storage system, along with the 700 PB Orion site-wide Lustre filesystem. Frontier consumes 21 MW (compared to its predecessor Summit's 13 MW); it has been estimated that the next US exascale system, Aurora, will consume around 60 MW.

History

The original design envisioned hundreds of thousands of GPUs and 150–500 MW of power. Oak Ridge partnered with HPE Cray and AMD to build the system. The machine was built at a cost of US$600 million. It began deployment in 2021 and reached full capability in 2022. It clocked 1.1 exaflops Rmax in May 2022, making it the world's fastest supercomputer as measured in the June 2022 edition of the

TOP500 The TOP500 project ranks and details the 500 most powerful non- distributed computer systems in the world. The project was started in 1993 and publishes an updated list of the supercomputers twice a year. The first of these updates always coinci ...

list, replacing Fugaku. Upon its release the supercomputer topped the Green500 list for most efficient supercomputer, measured at 62.68 gigaflops/watt. “Frontier is ushering in a new era of exascale computing to solve the world’s biggest scientific challenges,” ORNL Director Thomas Zacharia said. “This milestone offers just a preview of Frontier’s unmatched capability as a tool for scientific discovery. It is the result of more than a decade of collaboration among the national laboratories, academia and private industry, including DOE’s Exascale Computing Project, which is deploying the applications, software technologies, hardware and integration necessary to ensure impact at the exascale.”

References

{{S-end Cray products Exascale computers GPGPU supercomputers Oak Ridge National Laboratory X86 supercomputers 64-bit computers